The postgraduate medical educational climate assessed by the Danish Residency Educational Climate Test (DK-RECT): a validation and cross-sectional observational study.

BACKGROUND: A good educational climate is essential for delivering high-quality training for medical trainees, professional development, and patient care. The aim of this study was to (1) validate the Dutch Residency Educational Climate Test (D-RECT) in a Danish setting and (2) describe and evaluate the educational climate among medical trainees. METHODS: D-RECT was adopted in a three-step process: translation of D-RECT into Danish (DK-RECT), psychometric validation, and evaluation of educational climate. Trainees from 31 medical specialties at Copenhagen University Hospital - Rigshospitalet, Denmark were asked to complete an online survey in a cross-sectional study. RESULTS: We performed a forward-backward translation from Dutch to Danish. Confirmatory factor analysis showed that DK-RECT was robust and valid. The reliability analysis showed that only seven trainees from one specialty were needed for a reliable result. With 304 trainees completing DK-RECT, the response rate was 68%. The subsequent analysis indicated a positive overall educational climate, with a median score of 4.0 (interquartile range (IQR): 3.0-5.0) on a five-point Likert scale. Analysis of the subscales showed that the subscale Feedback received the lowest ratings, while Supervision and Peer collaboration were evaluated highest. CONCLUSIONS: Psychometric validation of D-RECT in a Danish context demonstrated valid results on the educational climate in specialist training. DK-RECT can be used to evaluate the effectiveness of interventions in the future and can facilitate the conversation on the educational climate.

Ensuring competence in ultrasound-guided procedures-a validity study of a newly developed assessment tool.

OBJECTIVES: To investigate the validity of the Interventional Ultrasound Skills Evaluation (IUSE) tool for assessment of procedural competence in ultrasound-guided procedures in a clinical environment, including a pass/fail score. METHODS: Novices and experienced radiologists were recruited from four hospitals and were observed and assessed while performing ultrasound-guided procedures. Performances were assessed using the IUSE tool by two independent raters. Validity evidence was gathered in accordance with Messick's framework: response process was ensured by standardisation of written rater instructions. Internal structure was explored using Cronbach's alpha for internal consistency reliability; inter-rater reliability was calculated as Pearson's r independently across all ratings, and test-retest reliability was reported using Cronbach's alpha. Relationship to other variables was investigated by comparing performances of the participants in each group. Consequences evidence was explored by calculating a pass/fail standard using the contrasting groups method. RESULTS: Six novices and twelve experienced radiologists were enrolled. The IUSE tool had high internal consistency (Cronbach's alpha = 0.96, high inter-rater reliability (Pearson's r = 0.95), and high test-retest reliability (Cronbach's alpha = 0.98), and the mean score was 33.28 for novices and 59.25 for experienced with a highly significant difference (p value < 0.001). The pass/fail score was set at 55 resulting in no false positives or false negatives. CONCLUSIONS: Validity evidence from multiple sources supports the use of the IUSE tool for assessment of competence in ultrasound-guided procedures in a clinical environment and its use in high-stakes assessment such as certification. A credible pass/fail criterion was established to inform decision-making. KEY POINTS: • A multi-site validity investigation established that the Interventional Ultrasound Skills Evaluation (IUSE) tool can be used to assess procedural competence in ultrasound-guided procedures. • Validity evidence was gathered according to Messick's framework validity from the following sources: response process, internal structure, relationship to other variables, and consequences evidence. • The IUSE tool can be used for both formative and summative assessment, and a credible pass/fail score was established to help inform decision-making such as certification.

DaPeCa-7: comparative assessment of fluorodeoxyglucose positron emission tomography/computed tomography (CT) and conventional diagnostic CT in diagnosis of lymph node metastases, distant metastases and incidental findings in patients with invasive penile cancer.

OBJECTIVES: To evaluate diagnostic accuracy of 18 F-fluorodeoxyglucose positron emission tomography/computed tomography (FDG PET/CT) compared to contrast-enhanced CT in assessment of inguinal lymph node (ILN) metastases, distant metastases and synchronous cancers in patients with penile squamous cell carcinoma (pSCC). PATIENTS AND METHODS: During a 4-year period, patients with pSCC were scheduled for FDG PET/CT prior to surgical treatment at two referral centres that manage all penile cancers in Denmark. The primary endpoint was diagnostic accuracy of FDG PET/CT and of CT alone with histopathology or Response Evaluation Criteria In Solid Tumors (RECIST) as reference. RESULTS: We evaluated 171 patients for distant metastases and synchronous incident cancers and examined 286 groins in 143 patients for LN metastases by FDG PET/CT. Six groins disclosed false negatives. FDG PET/CT sensitivity was 85.4% per patient. In 135 patients (270 groins), CT images were evaluated separately and 22 groins disclosed false negatives. CT sensitivity was 47.5% per patient. FDG PET/CT detected pSCC distant metastases in seven patients. Distant metastases from other cancers were newly detected in three patients. In eight patients, an incidental synchronous cancer was detected. Seven out of the 18 distant malignancies detected depended on FDG PET information. CONCLUSION: This study underlines the increased diagnostic accuracy of FDG PET/CT compared to CT alone in the evaluation of ILN status. In patients with palpable LNs, the advantage of FDG PET/CT over CT is less pronounced. FDG PET/CT may play a role in penile cancer evaluation.

Consensus on technical procedures in radiology to include in simulation-based training for residents: a European-wide needs assessment.

OBJECTIVES: To identify and prioritize technical procedures for simulation-based training that should be part of the education of residents in radiology. METHODS: This European-wide needs assessment study used a modified Delphi technique to gather consensus from different key education stakeholders in the field. The first round was a brainstorming phase to identify all procedures that a newly specialized radiologist should potentially be able to do. In the second round, each procedure was explored for the need for simulation training; the participants determined frequency, number of radiologists performing the procedure, impact on patient comfort and safety, and feasibility of simulation. The result of this round was sent back to the participants for final evaluation and prioritization. RESULTS: Seventy-one key education stakeholders from 27 European countries agreed to participate and were actively involved in the Delphi process: response rates were 72% and 82% in the second and third round, respectively. From 831 suggested procedures in the first round, these were grouped and categorized into 34 procedures that were pre-prioritized in the second round according to the need for simulation-based training. In the third round, 8 procedures were eliminated resulting in final inclusion of 26 procedures. Ultrasound procedures were highly ranked including basic skills such as probe handling; abdominal ultrasound; and ultrasound of kidneys, retroperitoneum, intestines, and scrotum. CONCLUSION: The prioritized list of procedures represents a consensus document decided upon by educational stakeholders in radiology across Europe. These procedures are suitable for simulation and should be an integral part of the education of radiologists. KEY POINTS: • The 26 identified procedures are listed according to priority and should be included as an integral part of simulation-based training curricula of radiologists across Europe. • This needs assessment is only the first step towards developing standardized simulation-based training programs that support the harmonization of education and training across Europe.

Evaluation of competence in ultrasound-guided procedures-a generic assessment tool developed through the Delphi method.

OBJECTIVES: To develop a generic and objective tool for assessing competence in percutaneous ultrasound-guided procedures. METHODS: Interventional ultrasound experts from the Nordic countries were invited to participate in a three-round Delphi process. A steering committee was formed to manage the process. In round 1, the experts were asked to suggest all aspects to consider when assessing competence in US-guided procedures. Suggestions were analyzed and condensed into assessment items. In round 2, the expert panel rated these items on a 1-5 scale and suggested new items. Items with a mean rating of ≤ 3.5 were excluded. In round 3, the expert panel rated the list items and suggested changes to the items. RESULTS: Twenty-five experts were invited, and response rates in the three rounds were 68% (17 out of 25), 100% (17 out of 17), and 100% (17 out of 17). The three-round Delphi process resulted in a 12-item assessment tool, using a five-point rating scale. The final assessment tool evaluates pre-procedural planning, US technique, procedural technique, patient safety, communication, and teamwork. CONCLUSIONS: Expert consensus was achieved on a generic tool for assessment of competence in percutaneous ultrasound-guided procedures-the Interventional Ultrasound Skills Evaluation (IUSE). This is the initial step in ensuring a valid and reliable method for assessment of interventional US skill. KEY POINTS: • Through a Delphi process, expert consensus was achieved on the content of an assessment tool for percutaneous ultrasound-guided procedures-the Interventional Ultrasound Skills Evaluation (IUSE) tool. • The IUSE tool is comprehensive and covers pre-procedural planning, US technique, procedural technique, patient safety, communication, and teamwork. • This is an important step in ensuring valid and reliable assessment of interventional US skills.

The Performance of Deep Learning Algorithms on Automatic Pulmonary Nodule Detection and Classification Tested on Different Datasets That Are Not Derived from LIDC-IDRI: A Systematic Review.

The aim of this study was to systematically review the performance of deep learning technology in detecting and classifying pulmonary nodules on computed tomography (CT) scans that were not from the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) database. Furthermore, we explored the difference in performance when the deep learning technology was applied to test datasets different from the training datasets. Only peer-reviewed, original research articles utilizing deep learning technology were included in this study, and only results from testing on datasets other than the LIDC-IDRI were included. We searched a total of six databases: EMBASE, PubMed, Cochrane Library, the Institute of Electrical and Electronics Engineers, Inc. (IEEE), Scopus, and Web of Science. This resulted in 1782 studies after duplicates were removed, and a total of 26 studies were included in this systematic review. Three studies explored the performance of pulmonary nodule detection only, 16 studies explored the performance of pulmonary nodule classification only, and 7 studies had reports of both pulmonary nodule detection and classification. Three different deep learning architectures were mentioned amongst the included studies: convolutional neural network (CNN), massive training artificial neural network (MTANN), and deep stacked denoising autoencoder extreme learning machine (SDAE-ELM). The studies reached a classification accuracy between 68-99.6% and a detection accuracy between 80.6-94%. Performance of deep learning technology in studies using different test and training datasets was comparable to studies using same type of test and training datasets. In conclusion, deep learning was able to achieve high levels of accuracy, sensitivity, and/or specificity in detecting and/or classifying nodules when applied to pulmonary CT scans not from the LIDC-IDRI database.

Simulation-Based Training of Ultrasound-Guided Procedures in Radiology - A Systematic Review.

PURPOSE: To perform a systematic review of the effect of simulation-based training (SBT) of percutaneous abdominal and thoracic ultrasound-guided procedures and to assess the transfer of procedural competence to a clinical context. MATERIALS AND METHODS: This systematic review was conducted in accordance with the PRISMA statement. Pubmed, Embase, Web of Science, and the Cochrane Library were searched for studies assessing procedural competence after SBT. Two authors independently reviewed all studies and extracted data. Risk of bias was assessed using the Cochrane tool for randomized studies (RoB) and non-randomized studies (ROBINS-I). Quality of evidence was assessed using the GRADE approach. RESULTS: 42 studies were included. 6 were randomized controlled, 3 non-randomized controlled, and 33 non-randomized non-controlled. 26 studies examined US-guided abdominal procedures, 13 examined thoracic procedures, and 3 examined both. The results favored SBT compared to other educational interventions and found that training was superior to no training. Only two studies examined the transfer of procedural skills to a clinical context. All studies had a high or critical risk of bias. Thus, the quality of evidence for the effect of SBT on procedural competence was low, and evidence for its transfer to a clinical context was very low. CONCLUSION: The evidence supporting SBT of percutaneous abdominal and thoracic US-guided procedures remains insufficient due to methodological problems and a high risk of bias. Future studies should be randomized and single-blinded, use assessment tools supported by validity evidence, compare different educational strategies, and examine the transfer of skills to a clinical setting.

Four Virtual-Reality Simulators for Diagnostic Abdominal Ultrasound Training in Radiology.

Ultrasound exams need skilled examiners, and simulation-based training could provide standardized and safe skill training. This study aims to give an overview of different types of virtual-reality simulators for use in abdominal diagnostic ultrasound training in radiology. Fifteen specialized radiologists and radiological residents were presented with two similar cases on four different simulators for abdominal ultrasound training. A feedback sheet for each individual simulator and for an overall comparison was filled out by all participants. All means of scores were compared, and simulators were ranked from least to most favorable. One simulator was ranked most favorable in seven out of nine questions, but none of the mean scores had statistically significant differences. All simulators were recommended for training radiologists, and all simulators were perceived to benefit trainees more than experienced ultra-sonographers.

Simulator training improves ultrasound scanning performance on patients: a randomized controlled trial.

BACKGROUND: Simulation-based mastery training may improve clinical performance. The aim of this study was to determine the effect of simulation-based mastery training on clinical performance in abdominal diagnostic ultrasound for radiology residents. METHOD: This study was a multicenter randomized controlled trial registered at clinicaltrials.gov (identifier: NCT02921867) and reported using the Consolidated Standards of Reporting Trials (CONSORT) statement. Twenty radiology residents from 10 different hospitals were included in the study. Participants were randomized into two groups: (1) simulator-based training until passing a validated test scored by a blinded reviewer or (2) no intervention prior to standard clinical ultrasound training on patients. All scans performed during the first 6 weeks of clinical ultrasound training were scored. The primary outcome was performance scores assessed using Objective Structured Assessment of Ultrasound Skills (OSAUS). An exponential learning curve was fitted for the OSAUS score for the two groups using non-linear regression with random variation. Confidence intervals were calculated based on the variation between individual learning curves. RESULTS: After randomization, eleven residents completed the simulation intervention and nine received standard clinical training. The simulation group participants attended two to seven training sessions using between 6 and 17 h of simulation-based training. The performance score for the simulation group was significantly higher for the first 29 scans compared to that for the non-simulation group, such that scores reached approximately the same level after 49 and 77 scans, respectively. CONCLUSION: We showed improved performance in diagnostic ultrasound scanning on patients after simulation-based mastery learning for radiology residents. TRIAL REGISTRATION: NCT02921867 KEY POINTS: • Improvement in scanning performance on patients is seen after simulation-based mastery learning in diagnostic abdominal ultrasound. • Simulation-based mastery learning can prevent patients from bearing the burden of the initial steep part of trainees' learning curve.

Determining procedures for simulation-based training in radiology: a nationwide needs assessment.

OBJECTIVES: New training modalities such as simulation are widely accepted in radiology; however, development of effective simulation-based training programs is challenging. They are often unstructured and based on convenience or coincidence. The study objective was to perform a nationwide needs assessment to identify and prioritize technical procedures that should be included in a simulation-based curriculum. METHODS: A needs assessment using the Delphi method was completed among 91 key leaders in radiology. Round 1 identified technical procedures that radiologists should learn. Round 2 explored frequency of procedure, number of radiologists performing the procedure, risk and/or discomfort for patients, and feasibility for simulation. Round 3 was elimination and prioritization of procedures. RESULTS: Response rates were 67 %, 70 % and 66 %, respectively. In Round 1, 22 technical procedures were included. Round 2 resulted in pre-prioritization of procedures. In round 3, 13 procedures were included in the final prioritized list. The three highly prioritized procedures were ultrasound-guided (US) histological biopsy and fine-needle aspiration, US-guided needle puncture and catheter drainage, and basic abdominal ultrasound. CONCLUSION: A needs assessment identified and prioritized 13 technical procedures to include in a simulation-based curriculum. The list may be used as guide for development of training programs. KEY POINTS: • Simulation-based training can supplement training on patients in radiology. • Development of simulation-based training should follow a structured approach. • The CAMES Needs Assessment Formula explores needs for simulation training. • A national Delphi study identified and prioritized procedures suitable for simulation training. • The prioritized list serves as guide for development of courses in radiology.

Development of a reliable simulation-based test for diagnostic abdominal ultrasound with a pass/fail standard usable for mastery learning.

BACKGROUND: This study aimed to develop a test with validity evidence for abdominal diagnostic ultrasound with a pass/fail-standard to facilitate mastery learning. METHOD: The simulator had 150 real-life patient abdominal scans of which 15 cases with 44 findings were selected, representing level 1 from The European Federation of Societies for Ultrasound in Medicine and Biology. Four groups of experience levels were constructed: Novices (medical students), trainees (first-year radiology residents), intermediates (third- to fourth-year radiology residents) and advanced (physicians with ultrasound fellowship). Participants were tested in a standardized setup and scored by two blinded reviewers prior to an item analysis. RESULTS: The item analysis excluded 14 diagnoses. Both internal consistency (Cronbach's alpha 0.96) and inter-rater reliability (0.99) were good and there were statistically significant differences (p < 0.001) between all four groups, except the intermediate and advanced groups (p = 1.0). There was a statistically significant correlation between experience and test scores (Pearson's r = 0.82, p < 0.001). The pass/fail-standard failed all novices (no false positives) and passed all advanced (no false negatives). All intermediate participants and six out of 14 trainees passed. CONCLUSION: We developed a test for diagnostic abdominal ultrasound with solid validity evidence and a pass/fail-standard without any false-positive or false-negative scores. KEY POINTS: • Ultrasound training can benefit from competency-based education based on reliable tests. • This simulation-based test can differentiate between competency levels of ultrasound examiners. • This test is suitable for competency-based education, e.g. mastery learning. • We provide a pass/fail standard without false-negative or false-positive scores.

Clinical utility of 18F-FDG positron emission tomography/computed tomography scan vs. 99mTc-HMPAO white blood cell single-photon emission computed tomography in extra-cardiac work-up of infective endocarditis.

The extra-cardiac work-up in infective endocarditis (IE) comprises a search for primary and secondary infective foci. Whether 18FDG-PET/CT or WBC-SPECT/CT is superior in detection of clinically relevant extra-cardiac manifestations in IE is unexplored. The objectives of this study were to identify the numbers of positive findings detected by each imaging modality, to evaluate the clinical relevance of these findings and to define the reproducibility for extra-cardiac foci in patients with definite IE. Each modality was evaluated for numbers and location of positive extra-cardiac foci in patients with definite IE. A team of 2 × 2 cardiologists evaluated each finding to determine clinical relevance. Clinical utility was determined by 4 criteria converted into an ordinal scale. Using the manifestation with highest clinical utility rating in each patient, the clinical impact of the two imaging modalities was expressed in a clinical utility score. To evaluate reproducibility for each modality, an imaging core laboratory reviewed all findings. In 55 IE patients, 91 pathological foci were found by FDG-PET/CT and 37 foci were identified by WBC-SPECT/CT (p < 0.001). The clinical utility of FDG-PET/CT was significantly higher than that of WBC-SPECT/CT when comparing clinical utility score (2.06 vs. 1.17; p = 0.01). In assessment of extra-cardiac diagnostics in IE, inter-observer reproducibility was substantial for WBC-SPECT/CT (k 0.69, 95% CI 0.49-0.89) and substantial to excellent for FDG-PET/CT (k 0.79, 95% CI 0.61-0.98). FDG-PET/CT has a significantly higher clinical utility score than WBC SPECT/CT and is potentially superior to WBC-SPECT/CT in detection of extra-cardiac pathology in patients with IE.

Angiosarcoma of the Scalp: Metastatic Pulmonary Cystic Lesions Initially Misinterpreted as Benign Findings on 18F-FDG PET/CT.

Angiosarcomas are rare and only represent about 2% of all soft tissue sarcomas. They arise from vascular or lymphatic endothelial cells and are most commonly located in the heart, liver, breast, and skin. Cutaneous angiosarcoma of the scalp is highly malignant and with dismal prognosis. Reported five-year survival is <30%. The mainstay of treatment is surgical resection and adjuvant radiation therapy, but failure rates following local therapy are high. Cutaneous angiosarcoma of the scalp has a predilection for pulmonary metastases with a variety of morphologic patterns on imaging. Metastatic disease in terms of pulmonary thin-walled, cystic lesions, may not be hypermetabolic on (18)F-FDG PET and, as such, could be misinterpreted as benign findings. We present a case demonstrating the diagnostic uncertainty and delay in an elderly male with angiosarcoma of the scalp presenting with metastatic lung lesions following failure of local therapy.

Brown Tumors Due to Primary Hyperparathyroidism in a Patient with Parathyroid Carcinoma Mimicking Skeletal Metastases on (18)F-FDG PET/CT.

Parathyroid carcinoma only represents <1% of all cases of primary hyperparathyroidism (PHPT). Even rare, chronic PHPT may lead to excessive osteoclast activity, and the increased resorption leads to destruction of cortical bone and formation of fibrous cysts with deposits of hemosiderin-so-called brown tumors. These benign, osteolytic lesions may demonstrate FDG-avidity on (18)F-FDG PET/CT, and as such are misinterpreted as skeletal metastases. Regression of the lesions may occur following successful treatment. We present a case demonstrating the diagnostic work-up and follow-up of a patient with PHPT due to parathyroid carcinoma and with presence of brown tumors on (18)F-FDG PET/CT, visualizing the possible role of this imaging modality in the evaluation of treatment response in these patients.

[Method for evaluating the competence of specialists--the validation of 360-degree-questionnaire]. / Metode til kompetenceevaluering af speciallaeger--validering af 360-graders-skema.

INTRODUCTION: Assessment of physicians' performance focuses on the quality of their work. The aim of this study was to develop a valid, usable and acceptable multisource feedback assessment tool (MFAT) for hospital consultants. MATERIAL AND METHODS: Statements were produced on consultant competencies within non-medical areas like collaboration, professionalism, communication, health promotion, academics and administration. The statements were validated by physicians and later by non-physician professionals after adjustments had been made. In a pilot test, a group of consultants was assessed using the final collection of statements of the MFAT. They received a report with their personal results and subsequently evaluated the assessment method. RESULTS: In total, 66 statements were developed and after validation they were reduced and reformulated to 35. Mean scores for relevance and "easy to understand" of the statements were in the range between "very high degree" and "high degree". In the pilot test, 18 consultants were assessed by themselves, by 141 other physicians and by 125 other professionals in the hospital. About two thirds greatly benefited of the assessment report and half identified areas for personal development. About a third did not want the head of their department to know the assessment results directly; however, two thirds found a potential value in discussing the results with the head. CONCLUSION: We developed an MFAT for consultants with relevant and understandable statements. A pilot test confirmed that most of the consultants gained from the assessment, but some did not like to share their results with their heads. For these specialists other methods should be used.

Prevention of overuse injuries by a concurrent exercise program in subjects exposed to an increase in training load: a randomized controlled trial of 1020 army recruits.

BACKGROUND: It is unknown whether an exercise program can prevent overuse injuries in the lower extremity. An often encountered and important risk factor for the development of lower extremity overuse injuries is an abrupt increase in activity level. HYPOTHESIS: A preventive training program based on a literature review of intrinsic risk factors, and performed concurrent with an increase in physical activity, can reduce the incidence of overuse knee injuries and medial tibial stress syndrome, as well as increase running distance. STUDY DESIGN: Randomized controlled trial; Level of evidence, 1. METHODS: A total of 1020 soldiers aged 20.9 years (range, 19-26 years) undergoing 3 months of basic military training consecutively enrolled from December 2004 to December 2005. The prevention program consisted of an exercise program of 15 minutes' duration 3 times a week, including 5 exercises for strength, flexibility, and coordination; the placebo program consisted of 5 exercises for the upper body. RESULTS: During the observation period, 223 subjects sustained an injury, with 50 and 48 of these fulfilling the study criteria for overuse knee injuries or medial tibial stress syndrome, respectively. There were no significant differences in incidence of injury between the prevention group and the placebo group (incidence, 0.22 vs 0.19; P = .162; relative risk = 1.05 [range, 0.98-1.11]). The soldiers in the prevention group had the greater improvement in running distance in 12-minute run tests (82 vs 43 m; P = .037). CONCLUSION: An exercise program with an emphasis on muscular strengthening, coordination, and flexibility based on intrinsic risk factors identified through a literature review did not influence the risk of developing overuse knee injuries or medial tibial stress syndrome in subjects undergoing an increase in physical activity. The program increased maximal running distance in a 12-minute test.